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ABSTRACT 


The  problem  considered  is  that  of  constructing  the 

decomposition  of  a  vector  in  a  Hilbert  space  into  two  orthogonal 

components;  one  (the  "projection")  in  a  given  cone,  and  the 

* 

other  in  the  polar  cone.  The  projection  Z  can  be  expressed 

as  a  Fourier- type  expansion.  An  algorithm  for  constructing 

* 

this  expansion  is  given,  and  shown  to  converge  to  Z  . 


Key  Words:  Conic  decomposition.  Optimization  in  Hilbert  space. 

Projection  on  convex  cone,  Convex  cone,  Fourier  series. 
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1 .  Introduction 

A  classical  result  in  Hilbert  space  theory  states  that  each 
element  b,  of  a  Hilbert  space  H,  has  a  unique  orthogonal 

decomposition  with  respect  to  a  closed  subspace  McH,  i.e., 

,  *  * 
there  exists  a  unique  pair  (2  ,  y  )  such  that 

*  * 
b  =  2  +  y 

(1.1)  z*e  M 

*  1 

y  e  M 

Moreover  (e.g.  Dunford  and  Schwart2  [3])  the  component  y  is  the 
solution  of  the  quadratic  extremal  problem 

(1.2)  | |y*| |2  «  min  | |  b-z  | | 2  . 

zcM 

» 

The  so-called  projection  z  of  b  onto  M,  can  be  expanded 
as  a  Fourier  sum 

*  00 

(1.3)  z  =  E  a.  e, 

i=l  K  K 

where  (e^ )  is  an  orthonormal  basis  of  M,  and  ak  is  the  Fourier 
coefficient  ak  =  (b,e^).  When  M  is  given  as 

(1.4)  M  =  span  (a^:  k=l,  2,...} 

with  a^h  not  necessarily  being  orthogonal,  the  e^'s  in  (1.3)  are 
computed  as 

k 

(1.5)  e.  =  Z  X.  a. 

.  i=l  1  1 


-v  VN 
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where  the  coefficients  are  determined  by  the  Gram-Schmidt 
procedure . 

Consider  now  the  case  where  M  is  replaced  by  a  closed 
convex  cone  C.  Here  a  pair  (2*,  y*)  is  a  conic  decomposition 
with  respect  to  C,  if 


b  = 


*  * 
z  +  y 


(1.6) 


z  eC 
Y*eC* 


*  * 


(z  ,  y  ) 


o 


where  C*  is  the  polar  cone  of  C:  C*  =  (ycH:  (y,z)£  0,  VZeC). 

Existence  and  uniqueness  of  such  decomposition  as  shown  by 

* 

Moreau  [8] .  A  representation  of  y  similar  to  (1.2)  is 

(1.7)  |  |y  *  !  |  2  =  min  |  |b-z  |  |  2 . 

z  eC 


Problem  (1.7)  is  the  classical  minimum  distance  problem  of 
optimization  and  approximation  theory. 


The  fundamental  role  played  in  modern  optimization  theory  by  the 
subspace  and  cone  decompositions,  and  their  relations  to  the  minimum 
distance  problem,  are  well  advocated  in  the  books  by  Luenberger  [5], 
Dorny  [2]  and  Holmes  UJ,  among  others.  In  a  finite  dimensional 
space  (1.7)  is  a  quadratic  programming  problem,  and  the  projection 
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y*  can  be  computed  by  appropriate  quadratic  programming  algorithms. 
The  Cone  Decomposition  Theorem  (existence  and  uniqueness)  itself 
is  a  convenient  analytical  tool  to  treat  topics  such  as:  Theorems 
of  the  Alternatives,  Duality  in  Linear  Programming  and  more. 

An  interesting  application  of  conic  decomposition  is  discussed 
by  Mackie  [6],  following  the  approach  of  Moreau.  It  illustrates 
nicely  the  use  of  modern  concepts  in  optimization  theory  to  the 
solution  of  a  problem  in  particle  and  continuum  mechanics.  We 
outline  the  problem  below  and  discuss  it  in  more  details  in  Section  6. 

Example  1 . 1 

A  number  of  perfectly  smooth,  inelastic,  identical, 
spherical  ball-bearings  fits  exactly  in  the  interior  of  a  curved 
tube,  whose  radius  of  curvature  is  large  compared  with  the 
radius  of  a  ball,  and  are  supported  so  that  they  are  at  rest 
in  contact  with  one  another  with  gravity  acting  vertically 
downwards.  At  time  t=Q  this  support  is  removed  and  the  balls 
begin  to  fall.  The  problem  is  to  find  the  initial  acceleration 
of  each  ball,  and  in  particular  to  determine  which  balls 
initially  remain  in  contact,  and  which  tend  to  separate  from 
each  other. 

For  further  applications  see  e.g.  Moreau  1 8J  ,  Abeasis 
et  al.  [1]  and  Miersemann  [7]. 
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When  C  is  a  closed  convex  set,  the  solution  of  the 
minimum  distance  problem  (1.7)  is  attained  uniquely.  Thus  the 
mapping  Pc(b)  which  associates  with  an  element  beH,  its  closest 
point  in  C,  is  a  well  defined  function.  Properties  of  these  projection 
mappings  were  thoroughly  investigated  by  Zarantonello  [10],  from 
the  geometric  and  algebric  points  of  view.  In  particular  it  is 
shown,  that  the  algebra  of  projections  on  convex  cones  retains,  from 
the  algebra  of  linear  orthogonal  projections,  enough  similar 
properties  so  as  to  develop  a  spectral  theory,  in  the  spirit  of  the 
spectral  theory  of  linear  self adjoint  operators. 


The  purpose  of  this  paper  is  to  furnish  a  Courier  type 

★ 

representation  of  the  projection  Z  in  (1.7) ,  similar  to  (1.3) , 
(1.5),  l .e . , 


(1.8) 


Z  =  E  CW  dlc 

k=l  K  K 


id, 


Here 


(1.9)  C  =  cone  (ai:  i  =  1,  2,...  } 

is  the  closure  of  the  set  of  all  non-negative  finite  linear 
combinations  of  the  a^'s.  The  index  set  1^  and  the  coefficient 
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are  determined  by  the  CD  Algorithm  given  in  section  2. 

The  expression  (1.8)  is  a  generalization  of  (1.3),  (1.5). 
Indeed,  we  show  in  section  5  that  if  the  system  {a^}  is  ortho- 


ck  dk 


normal,  then  the  non-zero  terms  in  the  expansion  E 

®  k=l 

are  the  same  as  those  in  E  av  a.  . 

k-l 

A  representation  of  the  projection  z  in  terms  of  the 
original  spanning  set  {a^}: 


(1.10) 


z  = 


k=l 


ak  ak 


is  not  guaranteed  to  converge  even  if  C  is  a  subspace.  This 
is  shown  by  the  following  (another  example  is  given  by  Stakgold 
(9,  p.  290])  : 

Example  1.2 

00 

In  <-2,  the  Hilbert  space  of  sequences  such  that 

00 

E  | a  p<®,  consider  the  sequence  of  vectors  a1  defined  component- 
i=l  i 

wise  by 


1 

•H 

II 

i 

a . 

3 

-1 

j  -  i  +  1 

0 

otherwise . 

Let  b  = 

(0, 

-  1, 

0,  0,...),  and  M  =  span  {a1}.  Then  z*=  beM,  but 

it  is  easily  verified  that  there  exists  no  representation  of 
b  in  the  form  (1.10). 

Since  the  original  spanning  set  (a^)  is  not  adequate  for 


such  a  representation,  another  set  must  be  used.  In  the  subspace 
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case  this  is  the  set  of  orthonormal  vectors  (1.5),  while  in  the 
conic  case  it  is  the  set  of  d^'s  in  (1.8),  which  generally  are 
not  even  linearly  independent. 

In  spite  of  the  above  dissimilarity  between  the  orthogonal 
and  conic  expansions,  the  latter  still  retains  important  properties 
(e.g.  Bessel  inequality)  of  the  classical  Fourier  expansion. 

These  properties  are  obtained  in  sections  3  and  4. 

2.  The  Conic  Decomposition  Algorithm 

In  this  section  we  define  an  algorithm  (abbreviated  CD 
Algorithm)  for  the  construction  of  the  expansion  (1.8) .  We 
assume  with  no  loss  of  generality  that  the  spanning  vectors  are 
normalized:  J | a± | |  =  1,  i  =  1,  2,... 

Let  N  denote  the  positive  integers,  and  define  4>:N-*-N  as 
the  function  which  associates  with  neN  the  index  of  .the  first 
non-zero  digit  in  the  binary  expansion  of  n,  e.g.,  <j>{2)  =  2, 

<M3)  =  1. 

The  CD  Algorithm:  At  the  k-  th  iteration,  k  =  1,  2,... 

k  oo 

one  is  given  vectors  zk,yk  in  H,  and  scalars  where 

initially,  (k=l) 


(2.1)  yx  =  b 
1 

xL  =  0  VieN. 

Then  one  computes  vectors  dfc,  zk+1,  y k+1,  and  scalars  ck , 


as  follows 


2.2) 


2.3) 


2.4) 


2.5) 


(2.6) 


(2.7) 


(2.8) 


(2.9) 


*  N 
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The  first  few  steps  of  the  CD  Algorithm  are: 


Z1  “  0  '  V i  =  b  >  xf  *  0  Vi. 


Assuming  (b,  a1>>0,  we  have  for  k  =  1 : 


dl  =  al 


x2  =  ci  =  (b,  ax) , 


x?  =  0 

X 


Vi^l 


z2  =  c1  a1  =  (b,  a^)^,  y2  =  b  -  (b,  a^a^ 


and  for  k  =  2 


d7  =  _ 2  =  ®i 

2  ll*2ll  1 


cj  =  (V2,  d2)  =  (b- (b ,  a,)alf  a-, )  =  (b,  a,)  -  (b,  a,)  =  0 


1'  1  * 


Z3  "  Z2  '  y3  “  y2 


2 . 1  Remarks 


k+l, 


(a)  The  number  of  non-zero  elements  in  the  sequence  {x^  } ^ 

k  oo 

exceeds  that  of  the  sequence  {x^}^_i  by  at  most  one. 

00  k 

(b)  In  Lemma  3.1  we  prove  that  z.  =  Ex.  a.,  where  by 

i=1  k 

remark  (a)  the  sum  on  the  right  hand  side  is  finite.  Hence  x^ 

can  be  interpreted  as  the  "accumulated  coefficient"  of  a.  in  z.  . 

X  K 
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(c)  If  the  spanning  set  { a ^ }  is  finite,  with  say  n  elements, 
the  function  ( k )  should  be  redefined  as: 

4>  ( k)  =  k  3.<k<n 

<J>(n+k)  =  4>  (k)  k  =  1,  2,... 

With  this  modification  the  Algorithm  will  maintain  the  properties 
of  the  CD  Algorithm,  which  are  proved  in  the  next  sections. 

3 .  Properties  of  the  CD  Algorithm 

Some  properties  of  the  sequences  generated  by  the  CD 
Algorithm  are  given  in  the  next  four  lemmas,  and  will  be  used 
eventually  to  prove  its  convergence. 

Lemma  3. 1  . 

(3.1)  x*  >  0  Vi 

°°  k 

(3.2)  z. —  E  x  a.  ,  k=l , 2 , .  . . 

K  i=l  1  1 

For  k  =  2 ,  3 , . . . 

(3.3)  |  |yR 1 1 2  <  |  (yk_1(|2  -  c^.-L 

(3.4)  I  |Yk|  | 2  <  !  |b|  |2-V  °2  . 


Proof 

Inequality  (3.4)  is  a  direct  consequence  of  (3.3)  and  y^^b. 
The  other  assertions  are  proved  simultaneously  by  induction. 


»  N 


io 


Step  1:  k  =  1  The  relations  (3.1)  and  (3.2)  hold  by  (2.1). 
The  proof  of  (3.3)  for  k  ■  1  is  a  special  case  of  step  2. 

Assuming  the  validity  of  (3.1)  -  (3.3)  for  k,  we  prove 
their  validity  for  k  +  1,  dealing  separately  with  odd  and  even  k. 

Jr -f  1  Jr  4*1 

Step  2:  Odd  k  To  prove  (3.1)  note  that  for  i  ?  <M— yi-),  x^  * 
xk  >  0  by  induction,  while  for  i  =  $(^i),  xk+*  =  >  0  by 

(2.3) .  For  (3.2)  we  have 

Zk+1  =  Zk  +  ck  dk  by  (2,5) 


E  x.  a.  +  c.  d.  by  induction 
1=1  1  1  K  * 


1  *i  ai  +  3^{!iii)a(^(li±i)  +  cka$(^±i) 

k+1  t  i  i 

iy*(!S±i) 


by  (2.2) 


=  E 


xi  ai  + 


i^(k+i) 


(x*<^)  +  dkN(^) 


E  xk+1  ai  +  x 

•  -JA.  /k  +  1, 
1^(— ) 


k+i 


l*i±)  %  (Sii) 


by  (2.4) 


=  E 
i=l 


xk+1  a. 
1  1 


proving  (3.2)  . 

The  inequality  (3.3),  for  k  replaced  by  k+1  (k  odd)  is 
obtained  as  follows: 
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1 1  yittl 1 1 2  "  II  y  k  "  °k  dk  1 1 2  by  (2.5) 

“  1 1 yk 1 1 2  +  cl  *  2oic  <yk'dJt>-  since  Hdkll”lla4(Sji)ll"  1 

m* 

By  (2.3)  , 


(V  dk)  =  Ck 

(3.5)  °r 

<yk'd*’-  'k  “  - 

In  both  cases 

2 

-2  (yk,dk)<  -  2cR,  hence 

MW  I2  i  MykM2  +  °k  -  24  -  MykM2  -'ck  • 

completing  the  proof  in  step  2. 

k+l 

Step  2:  even  k  If  z  k  =  0,  x^  >^0  Vj.  by  (2.8).  Let 
zk  ^  0  and  define  f:R-*-R  by  f  (c)  =|  |yk  -  c  dk|  |^.  This  is  a 
convex  quadratic  function  which  attains  its  minimum  at  t^c*(yk/dk) 
Now  (3.4)  implies 

(3.6)  |  |yk(  |  2  <  I  |b|  |2. 

Since  f  (0)  =  |  |y k  I  I  2 »  and 

*HI«k||>  =  l|yk  -'(-l|«kM)  *k  II2-  I  lyk+zkll2*  INI2 

M  k  1 1 
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the  inequality  (3.6)  is  equivalent  to  f(0)  f  (**||sj(lt)> 
This  implies 


f(-|  |zkl  D  1  f(c)»  Vc  <  -  |  |*J  |  , 


therefore  ck  -  I  iz^  I  I  or  14-  — — — —  >  0 


and  so  *  x[  (1  + 


I  I  M  I 


)  >  0. 


By  the  above  and  (2.8) 


Zk+1  2k  +  Ck  dk  *  zk  +  °k 


ck  °°  k 

(1  +  - *_  )  E  x*  a  = 

IUJI  i-i  1  1 


=  £  (1  + 
i=l 


£ 

i=l 


ai 
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which  proves  (3.2). 

Finally,  since  (3.5)  still  holds  for  k  even,  the  proof  of 
(3.3)  for  k  odd  contains  also  the  proof  for  k  even.  This  completes 
the  proof  of  the  lemma.  □ 

Lemma  3 .  2 

(3.7)  I^ci  <_  |  1 1>  |  | 2  (Bessel  inequality). 

(3.8)  lim  c=o, 

i+co 

(3.9)  the  sequence  (jy^ll  is  monotonically  decreasing, 


*  \ 
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(3.10)  2keC  VkeN. 

Proof 

k  .  .  €D 

By  (3.4)  E  c.  <  ||b|p  for  all  k.  Hence  the  series  E  c.  is 

i=l  1  “  i=l  1 

convergent,  Bessel  inequality  (3.7)  holds,  and  the  general  term 

ci  of  the  series  tends  to  zero,  i.e.  (3.8)  holds.  The  validity 

of  (3.9)  is  an  immediate  consequence  of  (3.3),  while  (3.10) 

follows  from  (3.1)  and  (3.2).  Note  again  that  by  Remark  2.1  the 

series  in  (3.2)  is  finite.  □ 

The  next  result  states  roughly,  that  for  k  large  enough,  Yk 
is  "almost"  in  the  polar  cone  C*. 

Lemma  3. 3 

For  e>0  and  zeC  fixed,  there  exists  K  such  that 

(3.11)  (yk,  z)  <e  Vk>K. 

Proof 

We  first  prove  (3.11)  for  the  case  where  z=a^  for  some  i. 

By  (2.2)  appears  periodically  in  {dk>.  Denote  by  w  the  period 
of  ai  in  {dk }  (w  may  depend  on  i) .  By  (3.8)  we  have 

lc*l  i  sir  vk>Ki 

for  some  .  We  proceed  to  prove  that  (3.11)  holds  with  K=K^. 
Indeed,  fix  k>K^,  and  let 


►  S 


J.4 


dk-t  ai  » 


1<  £<k 


(such  l  exists  by  periodicity  of  a ^  in  {dk)).  By  (2.3)  and  (2.7) 
we  have 


°j-  (yj'  dj)  Vj  ' 


and  by  (2.5)  ,  (2.9) 


k-1 


Yk  =y 


k-1  -  Vl  dk-l  -  yk-t  -.^3  dj  -  yk-r  *3 


where  =  {jeN:  k-£  k-1,  dj  ^  0). 


Hence 


(yk'  ai}  ~  ^yk'  dk-f,as^yk-t"  . E  qjdj'  dk-*7 

]  ^ 


a  (Yk_£'  dk-£^  ”  ^  (d  j  ,  djj— — 


jeJ 


<  ck_,  +  l  |c, 

~  jeJx  3 


<3 j  J  j  •  |  I  bY  Cauchy-Schwartz  inequality 


=  c. 


_£  +  £  lc-jl  *  since  J  Jd .  ||  =  1  VjcJ, 

jeJ  J  J  J 


1 
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±i^T+*OT-dr+w;7TT=e' 

Now  let  z  be  any  element  of  C.  Since  C  =  span  {a^},  the 
neighborhood  of  z 

N(z?  T[t§tt)=  {U:  Hu-zll  1  rffETj1 

contains  an  element  v  which  can  be  expressed  as  a  finite  sum 

(3.12)  v  =  T.  x  .  a  .  ,  x.  >_  0  VjeJ-  , 
jeJ2  J  J  3 

where  J2  is  a  finite  index  set  of  cardinality,  say,  m. 


Define, 


<3-131  9  ”  2m  max  lx.) 

jtJ2  3 


By  the  first  part  of  the  lemma,  there  exists  such  that 
(3.14)  (yk,  a j )  e  Vk  j>  K ^  . 

Let  K  =  max  K . .  By  (3.12)  -  (3.13)  we  have  (y  ,v)  <  £■  ,  therefore 
jeJ2  3  k  "  2 

(y k *  z>  =  <yk*  v)  +  (yk*  *-v> 


1  -  +  I |ykl I  -  ll*-v|| 
2  K 
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-  7  +  *  TjfblT  *e  '  by  <3‘6)  and  VeN<Zf  2 []b{ |} • 

This  completes  the  proof.  Q 

The  next  lemma  shows  that  the  subsequences  (y^), 
k  =  2,  4,  6,... "tend  to  orthogonality". 

Lemma  3 . 4 

The  subsequence  { (y^ » ^ '  k  even)  satisfies 

(3.15)  lim  (y^,  zk)  ^  0. 

k-*-« 

Proof 

By  (2.9)  and  (3.6) 

11**11  =  Ilb-yk|l  <  ||b||  ♦  |  |y  *  1 1  <  2 1 1  b|  | , 

Hence  for  k  even  with  z]c^0»  by  (2.6) 

(*k'  zk>  |  “I  l*kl  I  |  (*k'  dk)  |  "  I  lzkl  I  ’  lCkl  - 
<  2  I  I  b|  |  |  c^|  . 

The  latter  upper  bound  converges  to  zero,  by  (3.8),  hence  (3.15) 
follows.  □ 


A  ^  % 
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4 .  Convergence  of  the  CD  Algorithm 

We  now  combine  the  results  of  the  previous  section  to  prove 
our  main  result: 

4.1  Convergence  Theorem.  The  sequences  (zk>  generated 

by  the  CD  Algorithm  converge  to  the  unique  components  y*,z;*  of 
the  conic  decomposition  (1.6)  respectively. 

Proof 

Using  the  properties  (1.6)  of  the  solution  y*,z*  one  obtains 

l|yk-y*M2  =  (yk-y*»  yk-y*)  =  (yk-y*,  (b-zk)  -  (b-z*» 

-  (yk-y*»  z*-zk)  =(yk»z*)  -  (yk*  zk)  -  ^y*»  z*)  +  (y*,  zk) 

• 

l(yk*  z*)  -  (yk#  zk)  ,  by  orthogonality  of  y*  and  z*,  and  the 
facts  y *eC* ,  zkeC.  By  Lemmas  3.3  and  3.4,  this  implies  that 
for  every  e>0  there  exists  a  large  enough  K  such  that  |  |y  k — y* | | ^ < e 
for  all  k>K,  k  even.  This  proves  convergence  of  the  subsequence 
(yk> »  h  even. 

By  (3.9)  the  sequence  |(ykMk=1  is  monotone.  Since  it  has 
a  convergent  subsequence,  the  entire  sequence  ||ykl|  must 
converge  to  ||y*||,  i.e., 

(4.1)  lim  | |y  | |  =  | |y* | |  . 

k-»»  * 

The  final  step  of  the  proof  is  to  show  that  the  convergence 
in  norm  (4.1)  implies  the  convergence  yk-*>y* .  Now, 


18 


||Ykl|2  =  l|b-Zk||2  “|| y*  +  Z*  -  zk||2 
=  I  |y  *  1 1 2  +  l|z*  -  zkll2  +  2  (y*#  z*  "  zk> 
-  ||y*ll2  +  I  |yk  -  y  *  1 1 2  -  2(yS  zk)  • 

Therefore 


I  |yk-y* 1 1 2  =  1 1 yk 1 1 2  -  1 1  y* 1 1 2  +  2<y*,  zk) 

1  I  |ykl  I2  -  I  |Y*I  I2  since  y*eC*,  zReC. 

The  latter  inequality  together  with  (4.1)  imply 

l|Yk  -y*M2  -  0,  or  yk  -  y*. 

Since  zR  =  b  -  Yk,  *k  •*  b  -  y*  -  **,  and  the  proof  is 
completed .  □ 

4 . 2  Re  mark e 

(a)  The  choice  of  the  initial  projection  z '  ^  0  in  the 

CD  Algorithm  is  merely  for  convenience.  In  fact  » j.  can  be 
chosen  to  be  any  element  of  C  without  affecting  the  validity 
of  the  preceding  results.  In  this  sense  Theorem  4.1  is  a 
global  convergence  result. 

(b)  In  the  CD  Algorithm,  a^^  appears  periodically  in  the 
sequence  ^k}k=i»  with  period  2^+^.  This  choice  is  by  no  means 
unique  in  order  to  guarantee  convergence.  Any  choice  for  which 
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the  distance  between  consecutive  occurences  of  in  (dk)  is 
bounded  will  do. 

5.  The  Subspace  Case 

In  this  section  we  discuss  the  case  where  C  is  a  subspace 
spanned  by  {a1#  a2 , . . . } .  The  CD  Algorithm  can  be  simplified 
in  this  case  and  the  resulting  expansion  has  greater  resemblance 
to  the  classical  Fourier  expansion. 

The  non- orthogonal  case.  Let  C  **  span  {a^,  where 

the  a^s  are  arbitrary  elements  in  l2  (in  particular  they  may  be 
non-orthogonal,  or  even  linearly  dependent.)  Here  the  series 
{x^  in  the  CD  Algorithm  can  be  dispensed  with,  and  (2.3)  is 
replaced  by 

t 

(2.3a)  cR  =  (yk,  dk) . 

A  careful  examination  of  the  results  of  sections  2-4  reveals 
that  they  remain  valid,  with  the  following  strengthening  of  the 
results  (3.4),  (3.11)  respectively: 

<s.d  Hyk+ill2  “INI2  “  l  ci  vk' 

(5.2)  lim  (yk,  2)  =  0. 

k-K» 
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Moreover,  a  necessary  and  sufficient  condition  for  equality  to 
hold  in  the  Bessel  inequality  (3.7)  can  be  added: 

t  c?  =  | | b | J  2  (Parseval's  formula) 

(5.3)  ■  i=1  1 

if  and  only  if  beC. 


Indeed  by  (5.1) , 
if  and  only  if  y 


£  <=?  -  Ill’ll2  -  I |y* II2- 

i=l  1 

*  -  0  or  equivalently  beC. 


Hence  (5.3)  holds 


The  Orthogonal  Case.  Let  C  be  the  subspace  spanned  by  the 
orthonormal  basis  {a^.  We  show  that  in  this  case  the  expansion 
generated  by  the  CD  Algorithm  (with  the  modification  (2.3a)  is 
a  generalization  of  the  classical  Fourier  expansion,  in  the 

4 

sense  that  the  non-zero  elements  of  the  former  coincide  with 
the  elements  of  the  latter.  More  precisely, 

Proposition  S, 1 .  Let  {c^}  and  {d^}  be  the  sequences  generated 

0 o 

by  the  CD  Algorithm  for  the  projection  2*  =  T.  c.  d.,  and  let 

i=l  1  l 

=  (b,  a^)  be  the  Fourier  coefficient  in  the  representation 
z*  =  Z  a^.  Then 


(5.4)  c.  = 


%  i  =  2"  -  1 

0  otherwise 


|akak 

. 

0 


otherwise 


Proof.  Let 


*1  -  °>  \+l  ■  «i  »i  -  *k  -  b  -  V  *  -  1.  2' 
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and 

Jf 

Ck  =  span 

We 

prove  (5.4) 

by  induction  on  i.  For 

i  = 

1  we  have  c^  =  = 

(fal 

and  d^ 

=  a1  by  (2.2) .  Assume 

that 

(5.4)  holds  for  i  = 

1, 

. . . ,  n— 1 . 

From  this  and  2  ±  -  0 

it  follows  that 


k 

do  =  E  a-i  a-i 
*  j  =  l  3  3 


^+1  , 


since  f  0  only  if  l  is  of  the  form  l 
and  by  (5.4).  Hence  if 

and  by  (5.4)  for  all  i 


and  for  such 
i  =  Zl+log2i 


j 


(5.5) 


Zi  Zl+(log*i] 


Where  [rj  denotes  the  integer  part  of  r.  The  induction  hypothesis 
now  shows  that  (5.5)  holds  for  i  =  l,...n,  since  z  is  the 

oo  n 

(n-l)-th  partial  sum  of  the  series  ,E  c.  d. .  Further,  since  the 

_  1= 1  *  ^ 

Fourier  expansion  satisfies  y^^eC^  ,  one  obtains 


->.6)  yi  “  b  Zi  b  Zl+[log2iJ  “  yi+(log2i]  E  Cflog2i] 


for  i  =  l,...,n.  If  2k_1  <_  n  <2k-l,  then  flog2n]  »  k-1 

and  by  (5.6)  y^  eC'L  .  By  (2.2),  (2.6),  the  first  appearance  of 

k~^  k 

a^  in  the  sequence  (di)  is  for  i  =  2  -l,  therefore  dncCJc_1 ,  and 
c  =  (y  ,  d  )  =  0.  If  n  =  2k-l,  then  Ilog,(n-l)J  =  k-1,  y  ,  * 
yk  by  (5.6),  and  dn  =  ak  by  (2.2),  implying  cn  =  (yn,  dn)  * 


y  v  n 
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(y 


n-l 


(b,  ak) 


c 

n- 


1 


=  a 


k 


dn-l'  ak*  =  ^Yk'  ak*  = 
by  orthogonality  of  {a^}. 


k-1 
-  T, 
i=l 


a  ■ 


0 


ak> 


6 .  An  Example 

We  return  to  the  problem  in  Example  1.1.  The  mathematical 
model  of  the  problem  is  (see  [6 ] ) : 


(6.1)  x±  =  b±  +  X._1  -  \L 

(6.2)  x.+1  -  x.  >  0 

(6.3)  X.  (*i+1  -  Xi)  -  0 

(6.4)  XQ  -  Xn  -  0,  X.  >  0 


l  ™  1, . . . ,n. 


x  lr . . . ,n-l 


i 


where  X^  is  the  instantaneous  reaction  between  the  i-th  and 
(i  +  1) -st  ball,  and  is  the  initial  acceleration  of  the 
i-th  ball  multiplied  by  its  mass  at  t=0 .  The  quantities  b^ 
are  given  in  terms  of  the  geometry  of  the  tube. 

Defining  =  X^_^  -  X^,  it  is  shown  by  Mackie  that  the 
problem  is  equivalent  to  finding  vectors  x,  m  such  that 

(6.5)  b=x+u,  (X,u)=0,  xeK,  ueK* 

where  K  is  the  set  of  vectors  satisfying  (6.2),  i.e. 

(?.6)  K=(x:  XTA>0)  , 

and  the  matrix  A  is  given  componentwise  by 


(6.7) 
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j=i 

j=i+l 

otherwise. 


It  is  well  known  that  the  polar  of  a  cone  given  in  the 

form  (6.6)  is  K*  =  cone  { #  a1  =  i-th  column  of  A.  Since 

K**=K,  problem  (6.5)  can  be  now  reformulated  in  the  format 

n+  ^ 

needed  for  our  purposes,  namely:  find  z,  y  eR  such  that 


b  =  z+y,  (z,  y)  =  0,  z£Cn»  yeC* 


where  Cn  =  cone  (a^}?_^  and  C*  =  (yeRn+^:  y^+^  "  y^  0  i=l,...,n) 


As  a  specific  example  consider  the  decomposition  of 

b  =  (-1,-1,  0 , . . . ,0) eRn+1.  Using  the  CD  Algorithm  for  n=4 ,  we 

3  111 

obtained  a  sequence  converging  to  Z*  =  (0,  -j)  , 

Y*  -  (-1,  j,  ^-)  ,  which  suggested  that  the  solution  for 

general  n  is  given  by 


(6.8) 


a  *  = 
n 


(0 


n-1 
n  ' 


n' 


4- 


y  *  = 
J  n 


'-1-  b 


1  k 


* 

This  is  indeed  the  solution:  the  relations  5?*eC*  and  (y*,  z  )=0 

n  n  n  n 

are  easily  verified,  while  the  condition  z*cCn  follows  by  noting 

n  k-1 

the  explicit  representation  z*  =  E  (1 — — ) a^ . 

k-2 

Turning  to  the  case  where  the  number  of  balls  is  infinite, 
we  now  deal  with  a  problem  in  the  Hilbert  space  &2*  Using  the 
natural  imbedding  of  Rn+*  in  i.e.f  xeRn+*  corresponds  to 


>  v  -» 
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(x^, _ ,xii+i>0,0, .  . .)  c£2,  the  cone  is  now  given  a:;  the 

conic  hull  of  a^el!^  given  by  (6.7).  A  look  at  (6.8)  suggests 
that 

(6.9)  z*  =  (o,  1,  0,  0,...)  ,  y*  =  (-1,  0,  0,...) 

is  the  solution  in  this  case.  Indeed,  the  relations  y*eC*, 

(z*,  y*)  =  0  can  be  verified  by  a  direct  computation.  Finally, 

z*  =  lim  z*  ec  since  z*  eC  and  C  is  closed. 
n->«  n  n 

Observe  that  though  z*eC,  it  cannot  be  expanded  directly  as 
a  non-negative  linear  combination  (finite  or  infinite)  of  the 
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